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Abstract 

We consider the characterization of the asymptotic behavior of the average minimum mean-squared error (MMSE) 
and the average mutual information in scalar and vector fading coherent channels, where the receiver knows the exact 
fading channel state but the transmitter knows only the fading channel distribution, driven by a range of inputs. We 
construct low-snr and - at the heart of the novelty of the contribution - high-snr asymptotic expansions for the 
average MMSE and the average mutual information for coherent channels subject to Rayleigh fading, Ricean fading 
or Nakagami fading and driven by discrete inputs (with finite support) or various continuous inputs. We reveal the 
role that the so-called canonical MMSE in a standard additive white Gaussian noise (AWGN) channel plays in the 
characterization of the asymptotic behavior of the average MMSE and the average mutual information in a fading 
coherent channel: in the regime of low-snr, the derivatives of the canonical MMSE define the expansions of the 
estimation- and information-theoretic quantities; in contrast, in the regime of high-snr, the Mellin transform of the 
canonical MMSE define the expansions of the quantities. We thus also provide numerically and - whenever possible 
- analytically the MelUn transform of the canonical MMSE for the most common input distributions. We also reveal 
connections to and generaUzations of the MMSE dimension. The most relevant element that enables the construction 
of these non-trivial expansions is the realization that the integral representation of the estimation- and information- 
theoretic quantities can be seen as an ^.-transform of a kernel with a monotonic argument: this enables the use of 
a novel asymptotic expansion of integrals technique - the Mellin transform method - that leads immediately to not 
only the high-snr but also the low-snr expansions of the average MMSE and - via the I-MMSE relationship - to 
expansions of the average mutual information. We conclude with applications of the results to the characterization 
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and optimization of thie constrained capacity of a bank of parallel independent coherent fading channels driven by 
arbitrary discrete inputs. 

Index Terms 

Capacity, Constrained Capacity, Fading Channels, AWGN Channels, MMSE, Mutual Information, Average MMSE, 
Average Mutual Information, Asymptotic Expansions, Mellin Transform. 

I. Introduction 

The characterization of the constrained capacity of fading coherent channels, where the receiver knows the exact 
fading channel realization but the transmitter knows only the fading channel distribution, driven by arbitrary inputs 
is a problem with significant practical interest. The importance relates to the fact that this quantity defines the 
highest information transmission rate between the transmitter and the receiver with a message error probability that 
approaches zero in systems that employ arbitrary and practical signalling schemes, such as m-phase shift keying 
(PSK), m-pulse amplitude modulation (PAM) or m-quadrature amplitude modulation (QAM) constellations, rather 
than the capacity-achieving Gaussian one, thereby establishing a benchmark to the design and optimization of 
practical communications systems. 

Unfortunately, the characterization of the constrained capacity, which - assuming that the fading channel variation 
over time is stationary and ergodic - is given by the average over the fading channel gain distribution of the mutual 
information between the input and the output of the channel conditioned on the channel gain, is complex due to 
the absence of closed-form expressions for the mutual information as well as the average mutual information. 

An innovative approach that also leads to a characterization - in asymptotic regimes - of the constrained capacity 
of key communications channels was put forth in HI, The approach capitalizes on connections between mutual 
information and minimum mean-squared error (MMSE) ||3l, H, key quantities in information theory and estimation 
theory, in order to express the mutual information or bounds to the mutual information in terms of the MMSE or 
bounds to the MMSE, respectively. Other applications of the relation between mutual information and MMSE can 
be found in 0, 0, Q, El, M, IM, El, HI, 113. 

In this paper, we leverage connections between the average value of the mutual information and the average 
value of the MMSE in a coherent fading channel to obtain characterizations of the average mutual information 
from characterizations of the average MMSE. We pursue the characterizations exclusively in the asymptotic regime 
of low signal-to-noise ratio (SNR) and, at the heart of the novelty of the contribution, in the asymptotic regime 
of high SNR. The asymptotic analysis, which bypasses the difficulty associated with the construction of general 
non-asymptotic results, often applies to a variety of practical scenarios leading to considerable insight. 

We also use, in addition to the connections between the average mutual information and the average MMSE, key 
techniques that lead to the asymptotic expansions of the quantities not only in the regime of high SNR but also low 
SNR. In particular, by recognizing that the quantities can be seen as an /i-transform with a kernel of monotonic 
argument 11141 . we capitalize on expansions of integrals techniques, such as Mellin transform based methods or 
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integration by part methods, in order to construct the asymptotic expansions of the average MMSE and - via the 
connections between estimation and information theory - the average mutual information. 
The original contributions of the article include: 

• The identification of a comprehensive framework to construct asymptotic expansions of the average MMSE 
and the average mutual information in a single-input-single-output fading coherent channel driven by arbitrary 
inputs. The framework enables the construction of low- and - more importantly - high-SNR asymptotic 
expansions of the quantities in a unified way. 

• The construction of novel asymptotic expansions for the average MMSE and the average mutual information 
in a single-input-single-output fading coherent channel driven by arbitrary inputs. We conceive expansions 
applicable to arbitrary fading channels, which are specialized to Rayleigh fading channels, Ricean fading 
channels as well as Nakagami fading channels. We also conceive expansions applicable to discrete inputs with 
finite support and continuous inputs distributed according to oo-PSK, oo-PAM, oo-QAM and standard complex 
Gaussian distributions. 

• The generalization of the asymptotic results from single-input-single-output to single-input-multiple-output 
fading coherent channels driven by arbitrary inputs. 

• The application of the results in key communications problems. In particular, inspired by the ubiquitous use 
of Orthogonal Frequency-Division Multiplexing (OFDM) and multi-user OFDM based systems, we consider 
the determination of the power allocation policy that maximizes the constrained capacity of a bank of parallel 
independent fading coherent channels driven by arbitrary discrete inputs in the asymptotic regime of high SNR. 

This paper is organized as follows: Section [II] describes the channel model and the main estimation-theoretic 



and information-theoretic quantities. Sections III and IV which contain the main contributions, describe in detail 



the approach used to construct the asymptotic expansions of the estimation-theoretic and the information-theoretic 
measures. Section[V]describes generalizations of the approach. Section[Vl]includes a series of analytic and numerical 



Mellin transform results useful for the construction of the asymptotic expansions. Section VII presents a series of 
simulations that confirm the accuracy of the asymptotic expansions. Applications of the approach are covered in 
Section |VIII| Finally, we conclude with various remarks in Section |IX| 

A. Notation 

We use the following notation: Italic lower case letters denote scalars, boldface lower case letters denote column 
vectors and boldface upper case letters denote matrices, e.g., c, c and C, respectively. (•)*, (•)^ and (•)^ denote 
the complex conjugate, transpose, and complex conjugate transpose operators, respectively. The norm of a vector v 
is defined as \\v\\ VvU}. TZ{-) and !(•) denote the real and imaginary part operators, respectively. Ik denotes 
the kx k identity matrix. We denote the probability mass/density function of a discrete/continuous random variable 
X by fx (•) and the expectation of a function g (•) with respect to the random variable x by {g (x)}. Given 
cr > 0, we say that a complex random variable x is distributed according to CA/" (/x, 2a^Ik) if [JZ{x)'^ ,X{x)'^]'^ ^ 
A/" ([7^(/x)^,I(/x)-^]-^, cr^J2fc). log(-) denotes the natural logarithm throughout the paper. 
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We also use the following asymptotic notation as in lfl4l : We write 

f (x) ^ O (g (x)) , x-i'Xo 

if there exists a positive real number k, and a neighborhood of xq, N^q, such that, Va: S Nx„, \f {x)\ < k\g (x) 
We also write 

f {x) = o {g (x) ) , X -i' xq 

if for any positive real number e, there exists a neighborhood of xq, Nxg, such that, Vx G \f {x)\ < e\g (x) 
In addition, if {x)} , n = 0, 1, 2, . . ., is a sequence of continuous functions such that, Vn e Zq, 

(l^n+l (x) = O (0„ (x)) , X-i' Xq 

then we write 

n=0 

where the formal series in the right-hand- side may or may not converge, if 

m 

/ (a^) = X! (0m+i (a;)) , x xq 

holds Vm e and we write 



f [x) ^ a„0„ (x) , X Xq 



if 



/ (a^) = X! ("/""i+i (^)) ' X xo 

n=0 

holds only for m G {0, 1, . . . , iV - 1}. 

II. Model and Definitions 
We consider a standard frequency-flat fading channel, which for a single time instant, can be modeled as follows: 

y — \fsrvrhx + n (H-l) 

where y G C represents the channel output, x € C represents the channel input, /i is a complex scalar random 
variable (with support C or C \ {0}) such that {I^P} < +oo which represents the random channel fading gain 
between the input and the output of the channel, and 7i G C is a circularly symmetric complex scalar Gaussian 
random variable with zero mean and unit variance which represents standard noise. The scaling factor snr G M+ 
relates to the signal-to-noise ratio. We assume that x, h and n are independent random variables. We also assume 
that the receiver knows the exact realization of the channel gain but the transmitter knows only the distribution of 
the channel gain. 
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In particular, we consider three conventional fading models: /) the Rayleigh fading model; //) the Ricean fading 
model; and ///) the Nakagami fading model. In the Rayleigh fading model, the channel gain h ~ CM (0,2a^), 
where a > 0, and hence \h\ ^ Rayleigh (cr) |15 |, i.e.. 



r 



/NM-^exp(^-^j. (II.2) 

In the Ricean fading model, the channel gain h ^ CA/^ (/i, 2cr^), where /i e C \ {0} and a > 0, and hence 
-Rice(|/i|,a) 115J, i.e.. 



/HW = ^exp^-^-^j/o^^j (II.3) 

where Iq (•) is the modified Bessel function of the first kind with order zero lfT6l Equation 10.25.2]. In the Nakagami 
fading model, \h\ ~ Nakagami (/i, w), where fJ. > and w > ifTSl . i.e., 

where F (•) is the Gamma function lfT6l Equation 5.2.1]. 

We now introduce a series of quantities which will be used throughout the paper. We define the conditional 
MMSE given that the channel gain h ^ ho associated with the estimation of the noiseless output given the noisy 
output of the channel model in ( |II.l| l as 

|2 



mmseho (snr) ■.= E^^y\h< \hQX - E^\yji {hox\y, ho}\ 



ho 



and the conditional mutual information given that the channel gain h = ho between the input and the output of the 
channel model in ( |II.l| l as 

fx,y\h {x,y\ho) 



ha (snr) := E.^^y<h < log 



ho 



Jx\hix\ho) fy\h{y\ho), 

We also define the average value of the MMSE and the average value of the mutual information as follows: 

mmse (snr) := Eh {mmseh (snr)} (II.5) 

7{.snr):^Eh{hisnr)} (11.6) 

It will also be relevant to define the MMSE and the mutual information associated with the canonical additive 
white Gaussian noise (AWGN) channel model given by: 

y — \/snrx + n (II. 7) 

where y G C represents the channel output, x E C represents the channel input and n e C is a circularly symmetric 
complex scalar Gaussian random variable with zero mean and unit variance which represents standard noise. The 
scaling factor snr E also relates to the signal-to-noise ratio. We assume that x and n are independent random 
variables. 

Now, the MMSE associated with the estimation of the input given the output of the canonical AWGN channel 
model in pi.7| i is defined as: 

mmse (snr) := E^^y — E^\y {x\y}\^^ = mmsei (snr) (II. 8) 
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where mmsei {snr) denotes the conditional MMSE given that the channel gain h = 1 associated with the estimation 
of the noiseless output given the noisy output of the channel model in ( |n.l| i. The mutual information between the 
input and the output of the canonical AWGN channel model in is defined as: 

where Ii {snr) denotes the conditional mutual information given that the channel gain h = 1 between the input 
and the output of the channel model in ( |II.l[ l. Therefore, it is very simple to express the average MMSE in ( |II.5[ ) 
in terms of the canonical MMSE in dlLSll as: 



mmse {snr) = | |/ipTOmse (snr|ft,p) } (11.10) 
and the average mutual information in pi.6| l in terms of the canonical mutual information in \ll.9\ as: 

l{snr)^E\h\{l{snr\h\'')) (11.11) 

The objective is to characterize the asymptotic behavior, as snr — > oo or as snr — > 0+, of the average MMSE 
and the average mutual information, which, when the channel variation over time is stationary and ergodic, leads 
to the constrained capacity of a fading coherent channel driven by a specific input distribution. We adopt a two- 
step procedure: /) We first obtain, via Mellin transform expansion techniques or via integration by parts expansion 
techniques, a characterization of the asymptotic behavior of the average MMSE in ( |II.5| i; //) We then obtain a 
characterization of the asymptotic behavior of the average mutual information in ( |II.6| l by capitalizing on the now 
well-known relation between average MMSE and average mutual information given by |,4J: 

dl {snr) 

— = mmse {snr) (11-12) 

dsnr 

We note that the Mellin transform of a function /(•), which is defined as follows lfT4l : 

r+oo 

M [/; 1 + z] := / <V {t) dt, 
Jo 

plays a key role in the definition of the asymptotic expansions. 

III. HiGH-SNR Regime 

We now consider the construction of high-snr asymptotic expansions of the average MMSE and the average 
mutual information in a fading coherent channel driven by inputs that conform to either arbitrary discrete distributions 
(with finite support) or oo-PSK, cx)-PAM, oo-QAM, and standard complex Gaussian continuous distributions. 
The study of the first three continuous distributions, which represent the limit as to — > +oo of the well-known 
equiprobable to-PSK, to-PAM or to-QAM discrete distributions, is justified by the fact that it is often analytically 
convenient to approximate discrete constellations using continuous distributions over a suitable region on the complex 
plane, in order to define meaningful asymptotic notions such as the shaping gain |17|. 

We proceed by obtaining a high-snr asymptotic expansion of the average MMSE and then - via the connection 
between average MMSE and average mutual information in pi.l2| i - a high-sn?- asymptotic expansion of the average 
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mutual information. The construction of the high-snr expansions capitalizes on the fact that the average MMSE, 
which can be written as 

/>+oo ( \/t\ 

mmse {snr) — {\h\'^mmse (snr|/ip) } — / ^^--^ — -mmse {snr ■ t) dt, (III.l) 

can be seen as an /i-transform with a kernel of monotonic argument fT4^ Chapter 4]. This enables the use of a 
key asymptotic expansion of integrals technique, which exploits Mellin transforms llT4l Section 4.4], that leads to 
a dissection of the asymptotic behavior of the quantities in a large variety of scenarios. In fact, the construction of 
the high-snr expansions of the integral representation in ( |III.l| i can be effected by exploiting a range of techniques, 
such as the Mellin transform method llT4l Section 4.4] or the integration by parts methods llT4l Chapter 3]. It is 
important to emphasize though that the Mellin transform technique - when compared to the integration by parts 
technique - is able to produce expansions for a wider range of fading and input distributions. 

A. Discrete Inputs 

We consider arbitrary discrete inputs with finite support {xi, . . . , Xm} with m E Z+ and xi, . . . , x^ G C. The 
construction of the high-snr expansions of the average MMSE associated with arbitrary discrete inputs with finite 
support capitalizes on the characterization of the decay of the canonical MMSE in the regime of high-snr in HI. 

The following Theorem defines the asymptotic expansion of the average MMSE in fading coherent channels 
driven by arbitrary (but fixed) discrete inputs with finite support, by capitalizing on the Mellin transform method lfT4l 
Section 4.4]. 

Theorem III.l. Consider the fading coherent channel in ( |n.l| i driven by an arbitrary discrete input with finite 
support and define 

which relates to the distribution of the fading process and 

7:-inf{7* :/(<) = O(t-^'),t^0+} , 
5 := sup |(5* : f{t) = (t-'^'^j , t ^ +oo| , 
C:=]0,+oo[n]l-^,l-7[. 

+00 N{m} 

f (t) ^ exp {-qt-^) E (log ' ^^^^ 

rn—O n— 

where Tl{q) > 0, /i > 0, A'^ (m) is finite for each m, Pmn G C and TZ (am) t +oo, 

7 < (5 (III.3) 
C 7^ (III.4) 
3ceC:Va;e [c,+oo[,M[/;l-2;-iy] =0(|y|~2), |y| ^ +oo (III.5) 
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where M [f;l ~ x — iy] is to be understood as the analytic continuation of M [/; 1 — a; — iy]from {x + iy : 1 — 6 < 
X < 1 ~ j} to {x + iy : X > 1 — 5} l[18]l . then 
1) If q = it follows that 

mmse (snr) ^ 

N{m) n / \ 

I — ^ I — , / n.\ / s 

, snr — > +00 (III.6) 



^ snr-'-^- J2 PmnJ2 ( .] (-log(s7ir))^ M(^ 

m=0 n=0 j=Q ^ 



\mmse: z] 



z—l+ajy 



2) If q^O it follows that 

Vi?, G M^, mmse (snr) — o (snr~^) , snr — >■ +c» (111.7) 
Proof: See Appendix [A| ■ 



Theorem III. 1 provides a dissection of the asymptotic behavior as snr — > +oo of the average MMSE in a fading 
coherent channel driven by arbitrary discrete inputs (with finite support) under very general fading conditions. In 
particular, the Theorem requires that the asymptotic expansion as f — > 0+ of / (t), which relates to the probability 
density function of the fading random variable, behaves as in ( |III.2| i and that the Mellin transform of the function 
/(•) exists, is holomorphic in a certain vertical strip in the complex plane and decays along vertical lines as in 
pil.5| l. If the fading model does not accommodate for exponential decay of / {t) as i — > 0+, i.e., q = 0, then the 
average MMSE behaves as in ( |III.6| i; otherwise, if the fading model accommodates for exponential decay of / (t) 
as t ^ 0+, i.e., q 0, then the average MMSE behaves as in ( |ni.7| i. The Theorem also requires the existence of 
the Mellin transform of the canonical MMSE and their higher-order derivatives, which is guaranteed by the fact 
that the input distribution is discrete without accumulation points. 



Theorem |III. 1 1 reveals that in the important scenario which accommodates for the most common fading models 
(i.e., q = 0) the asymptotic behavior as snr — > +oo of the average MMSE depends mainly on the asymptotic 
behavior as t 0+ of / (t). Interestingly, the fact that the behavior of some quantities around zero determine the 
behavior of other quantities in the infinity has aheady been pointed out in e.g. lfT9l . Il20l . EH . Theorem |III. 1 1 also 
reveals that the asymptotic behavior as snr — > +oo of the average MMSE depends on the input distribution via 
the Melhn transform of the canonical MMSE. 



Theorem III.l can also now be immediately specialized to the most common fading distributions, including: /) 



Rayleigh fading; /;) Ricean fading; and ///) Nakagami fading. 

Corollary III.2. Consider a Rayleigh or Ricean fading coherent channel as in ( |II. 1[ ) driven by an arbitrary discrete 
input with finite support, where ( |II.2[ l or ( |II.3| l hold, respectively. Then, in the regime of high-snr the average MMSE 
behaves as follows: 



mmse [snr 



^ ^ ^ > > M [mmse; 2 + m 



snr — )■ +00 
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Proof: See Appendix [B] ■ 

Corollary III.3. Consider a Nakagami fading coherent channel as in ( |II.l| l driven by an arbitrary discrete input 
with finite support, where (|II.4|l holds. Then, in the regime of high-snr the average MMSE behaves as follows: 



mmse (snr) ~ r— — r > ; M [mmse; 1 + /i + mj , snr — >■ +oo 



Proof: See Appendix [C] 



The high-snr asymptotic expansions of the average MMSE embodied in Corollaries III.2 and III.3 lead imme- 
diately to a high-snr asymptotic expansion of the average mutual information, by leveraging the following integral 
representation of the connection between average MMSE and average mutual information in ( |II.12[ l given by: 

/•CO 

/ (snr) = log (to) — / mmse (e) de (III.8) 

J snr 

Corollary III.4. Consider a Rayleigh or Ricean fading coherent channel as in ( |II. 1[ ) driven by an arbitrary discrete 
input with finite support, where ( |II.2| l or ( |II.3| l hold, respectively. Then, in the regime of high-snr the average mutual 
information obeys the expansion: 

I (snr) ^ log (to) — 



\2n 



-p(-g^) g / (-1)-'" ^JfL^ I „[„,„,,2 + H 



snr — > +00 



snr 



Corollary III.5. Consider a Nakagami fading coherent channel as in jll.l) driven by an arbitrary discrete input 
with finite support, where < \ll.4} holds. Then, in the regime of high-snr the average mutual information obeys the 
expansion: 

/ (snr) ~ log (to) - _^„,T.,,.^...„ I r.. , ^A^i^^m ^^ [mmse; 1 + p + m] ) — ^, snr ^ +oo 



snr^r (u) ^—^ \ (/^ + "m) 



Proof of Corollaries \III.4\ and \III.5\ The Corollaries follow immediately from Corollaries |III.2| or |III.3| and the 
relationship in ( |ni.8| l, together with the fact that an order relation can be integrated with respect to the independent 
variable OH. ■ 



It is now relevant to reflect on the nature of the asymptotic expansions embodied in Corollaries III.2 III.3 



ni.4 and III.5 The expansions expose a dissection of the asymptotic behavior as snr +oo of the quantities. 
For Rayleigh and Ricean fading the (to + l)-th term in the average MMSE expansion is O (snr^™^'^) and the 
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(m + l)-th term in the average mutual information expansion is O (^snr^^^^^y, in contrast, for Nakagami fading 
the (m + l)-th terms in the average MMSE and the average mutual information expansions are O (snr^™~^^'^) 
and O {snr^™'^^), respectively. In Rayleigh or Ricean fading channels, a first-order high-srir expansion of the 
quantities can be written as follows: 

mmse (snr) = e • ^ + O 

and 

/ (snr) ^ log (to) — e • h O 

snr 



where 



exp 



e = lim snr^'^^ ■ mmse {snr) — — - — r M [mmse] 1 + /^] 



e = lim snr ■ mmse (snr) = — —M [mmse; 2] 

sni — ^+oo 2(7 

In contrast, in Nakagami fading channels, a first-order high-snr expansion of the average MMSE and the average 

mutual information can be written as follows: 

, , 1 ^ / 1 

mmse (snr) — e ■ r— h O ^— 

and 

/ (snr) ~ log (to) • h O ( r-— 

^ ' ^ ' ^ snrt^ Vsnri+^ 

where 

sni — >-+oo r (^) 

This shows that the rate (on a log(snr) scale) at which the average MMSE or the average mutual information tend 
to the infinite-snr value is given by: 

_ li^ \og{nmTse(snr)) ^^^^^^ 

snr^+ca log (snr) 

and _ 

log (log (m) — / (snr)) 

- lim , ; -^^ ^ = 1 (III. 10) 

snr-y+oo log (snr) 

respectively, both for Rayleigh and Ricean fading channels, and is equal to 

log (mmse (snr) ) 

- hin , \ " ^l + t^ 
sni — y+oo log (snr) 

and _ 

log (log (m) — / (snr)) 

- lim , ^ = M 

sm — >-+oo log (snr) 

respectively, for Nakagami fading channels. The parameter e, which is akin to the MMSE dimension put forth 
in II22I . provides a more refined representation of the high-snr asymptotics. The incorporation of a higher number 
of terms in the expansions provides a more accurate approximation of the behavior of the quantities not only at 
high-snr but also medium-snr. 

Finally, it is also relevant to note that one can also construct asymptotic expansions by using other asymptotic 
expansions of integrals techniques. The following Theorem defines the asymptotic expansion of the average MMSE 
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in fading coherent channels driven by arbitrary (but fixed) discrete inputs with finite support, which follows from 
an integration by parts method lfT4l Chapter 3] rather than the Mellin transform method lfT4l Section 4.4]. 

Theorem III.6. Consider the fading coherent channel in ( |n.l| l driven by an arbitrary discrete input with finite 
support and define 

which relates to the distribution of the fading process. If 

/eC°°(M+) (III. 11) 

yneZ+,3 lim (t) < +00 (III. 12) 

Vn G Z+,/(") (t) ^ 0(t-2) ^ t^+oo (III.13) 



then 



(-lY 

fnfnse (snr) - ^ T^^zpr/*"'' mmse'^-"'-^^ (0) , snr ^ +oo (III.14) 



snr" 

rn—O 

where 



Vrn € Zj, mmse^~™~^^ (x) := / / '■■ / / mmse (tm+i) dtmj^idt„i ■ ■ ■ dt2dti (III. 15) 

J +00 J +C30 J +00 J +OQ 



Proof: See Appendix [D] 



We note that the asymptotic expansion of the average MMSE provided in Theorem III.l is defined via the 
Mellin transform of the canonical MMSE whereas the asymptotic expansion of the average MMSE provided in 
Theorem |III.6| is defined in terms of repeated integrals of the canonical MMSE. It is possible though to reconcile 



the asymptotic expansion in Theorem III.l with the asymptotic expansion in Theorem III.6 in some key scenarios. 



In particular, if the requirements of Theorems III. 1 and III. 6 hold and 

(Vm e Z+, (N{m) = A = m)) Aq = 
then the asymptotic expansions ( |III.6| l and ( |III. 14| i coincide because 



snr 



N{m) n 
n=0 j=0 



(— log {snr)y M^" [mmse; z] 



2— l+a„ 



— snr ^ "^PmoM [mmse; 1 + to] 

= snr-i->„o (-1)"+^ TOlTOTOse^-"'-!) (0) 



(-1) 



m+l 



snr 



m-\- 



(0) TOmse^-'"^!) (0) 



where the first and the last equalities are due to ( |III.16| l and the second equality is due to 

vm+l 



^ ( 1) 



- M[mmse] to + 1] 



(III. 16) 
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in view of ( |III.15| l and US] Equation 1.4.31]. 

There are various scenarios of relevance in practice where both Theorems produce the same expansions, such as 
the Rayleigh and Ricean fading coherent channel driven by arbitrary discrete inputs with finite support, because the 
Theorem requirements hold and pil.l6[ ) also holds. However, there are also scenarios where the Mellin transform 
method yields an expansion but the integration by parts method does not. One important case relates to the definition 
of the asymptotic expansions in a fading coherent channel driven by arbitrary discrete inputs with finite support, 
subject to Nakagami fading (where \h\ ~ Nakagami (/i, w)). The Mellin transform method allows us to define the 
asymptotic expansions when the fading parameter fi E [i, +cx)[. In contrast, the integration by parts method only 
allows us to define the asymptotic expansions when the fading parameter /i G [i,+oo[ \ Z+. This is due to the 
fact that such a method requires stronger smoothness properties of the integrand functions. The other important 
case, which is the subject of the next subsection, relates to the definition of the asymptotic expansions in a fading 
coherent channel driven by continuous inputs. Note that in such a setting the repeated integrals of the canonical 
MMSE - which are necessary to conceive the asymptotic expansions via the integration by parts method - do not 
often exist. 



B. Continuous Inputs 

We now consider the continuous inputs: /) unit-power C)o-PSK, where x is uniformly distributed over the circle 
{z e C : l^l = 1} on the complex plane; //) unit-power cxd-PAM, where x is uniformly distributed over the 
line [— \/3, a/S] on the complex plane; ///) unit-power oo-QAM, where x is uniformly distributed over the square 



on the complex plane; and iv) standard complex Gaussian inputs, where x is distributed 
according to C7V(0, 1). 

The construction of the high -snr expansions of the average MMSE associated with oo-PSK, oo-PAM and oo- 
QAM uses the high-snr expansions of the canonical MMSEs given by IT]: 



mmse 



>-PSK 



(snr) 



1 



mmse°°'^^^ (snr) 



mmse 



oo-QAM 



(snr) 



2 snr 
1 

2 snr 
1 

snr 



O 
O 

o 



1 



snr^ 
1 

I 

snr 2 
1 

snr 2 



snr 



-00 



snr +00 



-00 



(111.17) 
(III. 18) 
(III. 19) 



respectively. It is important to note that this one-term expansions of the canonical MMSE lead to one-term expansions 
for the average MMSE; higher-order expansions for the canonical MMSE would lead to higher-order expansions for 
the average MMSE, by exploiting identical techniques. In contrast, the construction of the high-snr expansions of 
the average MMSE associated with standard complex Gaussian inputs uses the high-snr expansion of the canonical 
MMSE given by [1]: 

1 _ 1 1 

- snr snr — — h 1 

snr m=0 



-t-C30 



mmse^ (snr) 



1 



„-(m+l) 



+00 



(III.20) 
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The following Theorem defines the asymptotic expansions of the average MMSE in a fading coherent channel 
driven by oo-PSK, cx)-PAM, oo-QAM or standard complex Gaussian continuous input distributions. It is relevant 
to note that the proof relies on the use of the more powerful MelUn transform asymptotic expansion of integrals 
technique. 

Theorem III.7. Consider the fading coherent channel in ( |II.l| l driven by an oo-PSK, oo-PAM, oo-QAM or standard 
complex Gaussian continuous input and define 

which relates to the distribution of the fading process and 

7:= inf{7* :/(t) = o(t-^'),<^0+} 
5 sup \5* : f{t) = {t^^') , < ^ +oo| 
C:H0,l[n]l-<5,l-7[ 



If 



+00 N{m) 

f {t) ^ exp {-qt-'^) E P™"^"" (log W)" ■ 



t 0+ 



(III.21) 



m— n— 

where TZ{q) > 0, /i > 0, N (m) is finite for each m and TZ {a„i) t +oo> 



{x 9^ C7V(0, l)Aq = 0)^n (ao) > (III.22) 

7 < (5 (III.23) 

C ^ (III.24) 

3ceC -.^x e[c,+oo[,M[f;l-x-iy]=0 {\y\-^) , |y| ^ +00 (III.25) 

where M [f;l — x — iy] is to be understood as the analytic continuation of AI [/; 1 — a; — iy] from {x + iy : 1 — 6 < 
X < 1 — j} to {x + iy : X > 1 — 5} Iil8]l . then 
1) lfq = then: 

a) If X is distributed according to oo-PSK it follows that 
M[f;0 



mmse (snr) 



2snr 



O 



snr ^ +00, Vi? e]l,min{7^(ao) + 1,2} [ 



h) If X is distributed according to oo-PAM it follows that 



mmse (snr) 



M[f;0] 
2snr 



O 



1 



snr — > +00, 



c) If X is distributed according to oo-QAM it follows that 



mmse (snr) 



M[/;0] 



snr 



O 



1 



snr — > +00, 



1, mill < TZ (ao) + 1, 



1, mill < TZ (ao) + 1, 
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d) If X is distributed according to standard complex Gaussian it follows that 

mmse [snr) ^ zttt 1" 



y.ra+1 



rneR 



N(m) 



{— log {snr)y 



n=0 j=0 
]V(m) + l 

- - "'^^ ^ 7! (]V(to) + 1 - ?■)! 

(]V(m) + l-j) 



V ^ V - 



X 



(z — m — 1) 



Ar(m)+2 



TTAf [/; 1 - 

sin (ttz) 



TT 

sin (ttz) 



2 — l+a„ 



z—m+1 



where 

R := |m G Z(j" : '^n G Z^J" : m = a„} 
A :— |n G Z(J" ; '^m G Z^j" : to = a„} 
i?A := {m G Z+ : m + 1 G {z G C : 3 (p, g) G Z+ X Z+ : z = p + 1 = a, + 1} } 

2) Ifq^O then: 

a) If X is distributed according to 00-PSK it follows that 

1 



, X M[f;0] , ^ 

mmse (snr) ~ — ; h C 



2,snr 

h) If X is distributed according to 00-PAM it follows that 

. ^ M[/;0] , ^ / 1 

mmse [snr) ^ — h C 

2snr 

c) If X is distributed according to 00-QAM it follows that 

. ^ M[f;0] , ^ / 1 

mmse (snr) ^ h C 



snr — >■ +00, 



snr — > +00, 



Vi? g]1,2[ 



Vi?G 



Vi?G 



1,3 
' 2 



1, 



d) If X is distributed according to standard complex Gaussian it follows that 



+00 



:(snr) - ^ 



m=0 



(~irAf [/;-to] 



snr — >■ +00 



Proof See Appendix |E] 



Theorem III.7 provides a simple asymptotic expansion as snr — > +00 of the average MMSE in a fading coherent 
channel driven by 00-PSK, 00-PAM, 00-QAM or standard complex Gaussian continuous inputs under very general 



fading conditions. In particular, this Theorem - akin to Theorem III. 1 - only requires that the asymptotic expansion 
as f ^ 0+ of / (t), which relates to the probability density function of the fading random variable, behaves as in 
( |III.21[ ) and that the Mellin transform of the function / (•) exists, is holomorphic in a certain vertical strip in the 
complex plane and decays along vertical lines as in pil.25| l. The error term in the asymptotic expansion is more or 
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less refined depending on whether the fading model does not (q = 0) or does (q ^ 0) accommodate for exponential 
decay of / (t) as t 0+. 

This Theorem - akin to Theorem |III. 1| - reveals that the asymptotic behavior as snr — > +oo of the average 
MMSE also depends on the asymptotic behavior as t — > 0+ of / (<). The proof of the Theorem also reveals that 
the canonical MMSE - via its Mellin transform - plays an important role in the construction of the asymptotic 
behavior of the average MMSE. 



Theorem |III.7| can also be immediately specialized to the most common fading distributions. 

Corollary III.8. Consider a Rayleigh or Ricean fading coherent channel as in ( |II.1[ ) driven by an oo-PSK, oo- 
PAM, oo-QAM or standard complex Gaussian continuous input, where ( |II.2| l or ( |II.3| l hold, respectively. Then, in 
the regime of high- snr the average MMSE behaves as follows: 
1) If X is distributed according to oo-PSK then 

1 „ A 1 



mmse (snr) 



O 



2snr \ snr' 
2) If X is distributed according to oo-PAM then 

1 „ / 1 



mmse (snr) 



O 



2snr \ snr 
3) If X is distributed according to oo-QAM then 

1 „ / 1 



mmse (snr) 



O 



snr — +CX), 



snr — > -\-oo, 



snr — +00, 



Vi? e]l,2[ 



Vi?e 



4) // X is distributed according to standard complex Gaussian it follows that 



mmse (snr) 



1 ^ _J_ 1 (- log 

snr snr-^ ^-^ snr"^ ^-^ 7! (1 



(— log (snr)y 



snr"^ ^ — ' 7! (1 — 7')! 

m=o j=o •' ^ ■' ' 



dz 



(i-j) 



(z — TO — 2)' 



7rexp(-g) (2^2)' 'r(2-z)i^^i(2-z;l; 
sin (ttz) 



z=m+2 



where iFi (a; b; c) is the confluent hypergeometric series M6\ Equation 13.2.2]. 



Proof The conditions required for this specialization have already been established in Subappendices B-A and 



B-B Note also that R = {0}, A = and RA = Z+ in both Rayleigh and Ricean cases. 



Corollary III.9. Consider a Nakagami fading coherent channel as in driven by an oo-PSK, oo-PAM, oo-QAM 
or standard complex Gaussian continuous input, where ( |II.4[ | holds. Then, in the regime of high-snr the average 
MMSE behaves as follows: 

1) If X is distributed according to oo-PSK then 

1 „ / 1 



mmse (snr) 



2snr 



O 



snr ^ +00, Vi? e]l, min{7x + 1, 2}[ 
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2) If X is distributed according to oo-PAM then 

mmse [snr) 



2snr ' V snr^ 
3) If X is distributed according to oo-QAM then 



, , 1 I 

mmse [snr) h O 



snr \ snr 



snr — >■ +00, Vi? G 



snr +O0, Vi? G 



4) If X is distributed according to standard complex Gaussian it follows that 
a) If [i,+oo[nZ+ then: 



mmse 



{snr) ^ 

snr ^-^ 



snr'' 
1 



+ 00 1/1 

I 1 (- log 

.i+fj, Z-^ snr™ ^—^ 7!(1 



(— log {snr)y 



sn7'^Tf ^ — ' snr"^ ^ — ' i\ (1 — 7')! 



dz 



(i-j) 



(z — m — 1 — /i) 



I- u) . . — ^ 



z—rn+l+fj, 



, snr — )• +00 
b) If^e [i , +00 [ \ Z+ f/ien; 

1 ±2? (-irrtTI) (^) r(M-m) 



mmse (snr) 



snr 



E 

m=0 

+00 



1 /i^ 



gj^j.i+fj. Z-^ snr"^ T (n) wf^ m\w"^ sin (tt (1 + /i + rn)) 

m— \ \ f / / 



snr — > +00 



Proof: The conditions required for this speciaUzation have akeady been estabhshed in Appendix |C] Note also 



that 



R = 



RA = 



in the Nakagami fading case. 



{0,1,2,...,^-!} if ^ e [i,+oo[nZ+, 
'4 if M e [l,+oo[\Z+, 

I if Me [^,+oo[nz+, 

Z+ if /iG [i,+oo[\Z+, 

{Af,/i+l,Ai + 2,...} if A* e [i,+oo[nZ+, 
if e [5,+oo[\Z+. 



It is evident that the high-snr behavior of the average MMSE for the most common fading coherent channel 
models is rather distinct for discrete and continuous inputs. For systems driven by discrete inputs the leading term 
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of the high-snr asymptotic expansion of the average MMSE is O (^^;^) for Rayleigh and Ricean fading channels 
and O ( g„^\+n ) for Nakagami fading channels; in contrast, for systems driven by oo-PSK, oo-PAM, oo-QAM or 
standard complex Gaussian inputs the leading term in the asymptotic expansion of the average MMSE is O (j^) 
for the four fading models. This is consistent with the fact that the high-snr average mutual information for systems 
with continuous inputs is higher than for systems with discrete inputs, i.e., it grows without bound for continuous 
inputs but it is bounded by the input cardinality for discrete inputs. 



The high-srtr asymptotic expansions of the average MMSE embodied in Corollaries III. 8 and III.9 do not lead 
directly to a high-snr asymptotic expansion of the average mutual information, because it is not possible to explore 
a suitable integral representation of the connection between average MMSE and average mutual information in 

dimi i. 

IV. Low-SNR Regime 

We now consider the construction of low-snr asymptotic expansions of the average MMSE and the average 
mutual information in a fading coherent channel driven by a range of inputs. The element of novelty, in view 
of the fact that examples of low-snr asymptotic expansions of a series of estimation- and information-theoretic 
quantities are plentiful (see e.g. ||231 . E?! ). relates to the use of Mellin transform expansions techniques to study 
the behavior of the quantities in such an asymptotic regime. This distinct unconventional approach, as opposed 
to the common method that involves in some suitable integral representation of the quantities the substitution of 
the integrand or part of the integrand by a series and its integration term by term, also illustrates that with Mellin 
transform expansions techniques one can often derive with little effort the asymptotic expansions as snr — > 0+ 
from asymptotic expansions as snr +co and vice versa thereby coupling the regimes II 141 . 

We also proceed by obtaining a low-snr asymptotic expansion of the average MMSE and then - via the connection 
between average MMSE and average mutual information in ( |II. 12| l - a low-snr asymptotic expansion of the average 
mutual information. 

A. Discrete and Continuous Inputs 

We consider arbitrary discrete inputs with finite support and unit-power oo-PSK, oo-PAM, oo-QAM or standard 
complex Gaussian continuous input^ The following Theorem, which applies to relatively general fading models, 
provides the asymptotic expansion of the average MMSE in fading coherent channels driven by a range of inputs. 

Theorem IV.l. Consider the fading coherent channel in ( |II.1[ ) driven by inputs that conform to: i) a discrete 
distribution with finite support; or ii) a oo-PSK, oo-PAM, oo-QAM or standard complex Gaussian continuous 
distribution. Define 

it) ^MZ^ 

'The expansions ai'e also applicable to finite-power inputs, i.e., < +oo, such that the canonical MMSE obeys mmse{snr) = 

O (—^) , snr — > +00. 

\ snr / ' 
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which relates to the distribution of the fading process and 

ai := inf : hi (t) ^ O (t-"'^) ,i ^ 0+| 
/3i := sup|/3i : hi (t) = O (^"'^^*) ,i-> +oo| 

]ai , /?! [n] — cx), 1 [ if X is discrete, 
]ai,/3i[n]0, 1[ if X is continuous. 



Ci := 



If 



where TZ (fci) > and vi > 0, 



hi(t) ^ 0{exp{-kif"')) , t^+oo 



(IV.l) 



ai < Pi (IV.2) 
Ci 7^ (IV.3) 

3cieCi:yxe[ci,+oo[,M[hi;x + ty] = 0{\y\-^), \y\ +oo (IV.4) 

where M [hi; x + iy] is to be understood as the analytic continuation of M [hi] x + iy]from {x+iy : ai < x < j3i} 
to {x + iy : X > ai}] IfWj , then 



+ 00 ^ 

{snr) ^ — -M[hi;m + IjTOmse^™^ (z) 



m=0 



snr — )■ 0^ 



z=0+ 



Proof: See Appendix |F] 



Theorem IV. 1 can also be immediately specialized to the most common fading distributions, including : /) Rayleigh 
fading; ii) Ricean fading; and Hi) Nakagami fading. 

Corollary IV.2. Consider a Rayleigh or Ricean fading coherent channel as in ( |II.l| l driven by an arbitrary discrete 
input with finite support or by oo-PSK, oo-PAM, oo-QAM or standard complex Gaussian continuous inputs, where 
(|II.2|l or (|II.3|l hold, respectively. Then, in the regime of low- snr the average MMSE behaves as follows: 



mTOse(snr) -exp ( -^"j ^ (m + 1) {2a^y'"^\Fi (2 + rn;l-J-^\ mmse^"''^ (z) 

\ ^ m=0 ^ 

where iFi (a; b; c) is the confiuent hypergeometric series [16' Equation 13.2.2]. 
Proof: See Appendix [G] 



snr 



snr — >■ O"*" 



z=0+ 



Corollary IV.3. Consider a Nakagami fading coherent channel as in ( |II.l| l driven by an arbitrary discrete input 
with finite support or by oo-PSK, oo-PAM, oo-QAM or standard complex Gaussian continuous inputs, where ( |II.4[ ) 
holds. Then, in the regime of low-snr the average MMSE behaves as follows: 

r (/i + m + 1) f 



;(snr) - ^ 



r(/i)r(m + i) 



mmse^"^^ (z) 



snr — > 0^ 



z=0+ 
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Proof: See Appendix [H] 



The low-snr asymptotic expansions of the average MMSE embodied in Corollaries |IV.2| and |IV.3| also lead 
immediately to a low-snr asymptotic expansion of the average mutual information, by leveraging the following 
integral representation of the connection between average MMSE and average mutual information in ( |II.12[ ) given 
by: 

psnr 

I {snr) = / mmse (e) de. (IV.5) 



^0 

Corollary IV.4. Consider a Rayleigh or Ricean fading coherent channel as in driven by an arbitrary discrete 

input with finite support or by oo-PSK, oo-PAM, oo-QAM or standard complex Gaussian continuous inputs, where 
( |II.2| l or ( |II.3| l hold, respectively. Then, the average mutual information obeys the low-snr expansion given by: 

1 2 \ +°° , , / I,, 12- 



I (snr) ^ exp (-^) ^ (2.^)"+^ (2 + m; 1; mmse^^^ (z) 

\ / m=0 ^ ^ 

where iFi (a; b; c) is the confluent hypergeometric series kl6{ Equation 13.2.2]. 



snr"^^^, snr ^ 0^ 

z=0+ 



Corollary IV.5. Consider a Nakagami fading coherent channel as in driven by an arbitrary discrete input 

with flnite support or by oo-PSK, oo-PAM, oo-QAM or standard complex Gaussian continuous inputs, where pi.4[ ) 
holds. Then, the average mutual information obeys the low-snr expansion given by: 



-J, . 1 r(^ + m + i) (wY"^^^ 

I {snr) > ^ , , , ^ — mmse^"'> {z) 



=0+ 



Proof of Corollaries \IV.4\ and \IV.5\ The Corollaries follow immediately from Corollaries |IV.2| or |IV.3| and the 
relationship in ( |IV.5| l, together with the fact that an order relation can be integrated with respect to the independent 
variable HD. ■ 

It is interesting to note the role that the canonical MMSE plays in the definition of the asymptotic expansions of 
the average MMSE and the average mutual information as snr — > 0+ and snr +00. The high-snr behavior of 
the quantities (for discrete inputs) is dictated via the Mellin transform and the higher-order derivatives of the Mellin 
transform of the canonical MMSE or, equivalently, the repeated integrals of the canonical MMSE. In contrast, the 
low-snr behavior of the quantities is dictated via the derivatives of the canonical MMSE. 

V. Generalizations 

We now consider a more general frequency-flat fading channel, which for a single time instant, can be modeled 
as follows: 

y = \/snrhx + n (V. 1 ) 
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where y — [j/i, . . . , j/fe]^ e C*^ represents the channel output, a; G C represents the channel input, h = [/ii, . . . , /i^]^ 
is a complex random vector such that { < +00, which represents the random channel fading gains 
between the input and the outputs of the channel, and n= [ni, . . . ^n^]^ e C*^ is a circularly symmetric complex 
Gaussian random vector with zero mean and identity covariance matrix which represents standard noise. The 
scaling factor snr G also relates to the signal-to-noise ratio. We assume that x, h and n are independent 
random variables/vectors. We also assume that the receiver knows the exact realization of the channel gains but the 
transmitter knows only the distribution of the channel gains. Note that the model in ( |V. l| i represents a generalization 
of the model in ( |II. that captures various communications scenarios such as the use of multiple antennas at the 
receiver 

We write the average MMSE associated with the model in (|V. l|i as follows: 



mmse (snr) :— Eh {mmseh (snr)} (V.2) 

where 

mmseho (snr) E^^y\h ^\\hox - E^^y^h {hQx\y,ho}\\^ \h ^ ft,o| 

represents the conditional MMSE given that the channel gains h = Hq associated with the estimation of the noiseless 
output given the noisy output of the channel model in ( |V.1[ ). We also write the average mutual information associated 
with the model in ( |V.l| i as follows: 

~I{snr):=Eh{Ih{.snr)} (V.3) 

where 



Iho {snr) := E^^y\h { log 



h — hn 



Jx\h {x\ha) fy\h iy\ho), 

represents the conditional mutual information given that the channel gains h = Hq between the input and the output 
of the channel model in ( |V. We can also immediately write the average MMSE in ( |V.2| i in terms of the canonical 
MMSE in as: 

mmse {snr) = E\\h\\ {\\h\\^mmse (snr|l/i|l^) } (V.4) 



and the average mutual information in ( |V.3| l in terms of the canonical mutual information in ( |II.9| ) as: 

7 {snr) = E\\h\\ {I {snr\\hf) } (V.5) 

The fact that the form of ( |V.4| l and ( |V.5[ ) is identical to the form of pi.lO| l and respectively, enables 

the use of the previous machinery to characterize the asymptotic behavior, as snr 00 or as snr 0+, of the 
quantities]^ 

^It is important to note that, whilst the generalization of the techniques is immediate from single-input-single-output to single-input-multiple- 
output channel models, such generalization does not seem possible to multiple-input-single-output or multiple-input-multiple-output channel 
models. 
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A. High-snr Regime 

1 ) Discrete Inputs: We now concentrate on the generalization of the characterizations of the asymptotic behavior 
as snr +co of the average MMSE and the average mutual information for vector Rayleigh and Ricean fading 
coherent channels driven by arbitrary discrete inputs with finite support. 

Corollary V.l. Consider a vector fading coherent channel as in ( |V. l| l driven by an arbitrary discrete input with 
finite support, where h ^ CM [fi, 2cr^Jfc) with /j, G C*^^^, and cr > 0. Then, in the regime of high-snr the average 
MMSE obeys: 

mmse (snr) ~ 

^ exp(-^) ^ / " / ||^||2n 

snri^+i Z^^yZ^^y^^ _ (2^2)"+"+* n!r {n + k) 



M \mmse: k + 1 + m] , snr +oo 



Proof: See Appendix |l] ■ 

Corollary V.2. Consider a vector fading coherent channel as in ( |V. l| l driven by an arbitrary discrete input with 
finite support, where h ^ CM (/x, 2(7^7^) with fi e C'^^^, and a > 0. Then, in the regime of high-snr the average 
mutual information obeys the expansion: 

I (snr) ^ log (to) — 

exp(--l^^) +00 / m / ,_^yn-n Hull^" \ \ 1 

V / f >_ — — , --] M\mmse]k + l + m]\ , snr ^ +00 

^^\{m + k){m~ji)\{2a^r+''+''n\T{n + k) j ^ ^ j snr--' 




Proof: The expansion follows immediately from the expansion in Corollary | V. 1 1 and the relationship in ( |III.8| l, 
together with the fact that an order relation can be integrated with respect to the independent variable lfT4l . ■ 

Note that the rate at which the average MMSE and the average mutual information tend to their infinite-snr values 
in the scalar channel model in is equal to 2 and 1, respectively, whereas the rate at which such quantities tend 
to their infinite-sn?' values in the vector channel model in ( |V.l| i is equal to fc + 1 and k, respectively. This indicts, 
as expected, that the availability of multiple receive dimensions leads to a lower value for the average MMSE and 
a higher value for the average mutual information for a certain signal-to-noise ratio. 

2) Continuous Inputs: We now focus on the generalization of the characterizations of the asymptotic behavior 
as snr +00 of the average MMSE and the average mutual information for vector Rayleigh and Ricean fading 
coherent channels driven by continuous inputs. 

Corollary V.3. Consider a vector fading coherent channel as in ( |V. l| l driven by an 00-PSK, 00-PAM, 00-QAM or 
standard complex Gaussian continuous input, where h ^ CM (/x, 2a^Ik) with fi € C*^'^^, and a > 0. Then, in the 
regime of high-snr the average MMSE obeys: 
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1) If X is distributed according to oo-PSK then 
mmse (snr) 



2snr \ snr^ 
2) // X is distributed according to oo-PAM then 



mmse (snr) 



2snr 



3) If X is distributed according to oo-QAM then 
mmse (snr) 



snr -i' +00, Vi?e]l,2[ 



snr — +0O, Vi? G 



snr — >■ +00, V-R G 



snr \ snr' 

A) If X is distributed according to standard complex Gaussian then 



mmse {snr) 



^1 (-irexp(-^) {2a^y 



m=0 



1 +°° 1 1/1 

I 1 (- log 

-fc+i /L^ snr^^ ^—^ ?' fl 



(— log {snr)y 



dz 



m—O 



3=0 



{z — m — k — ly 



^exp (-^) {2a^r' '-^^F, (l - z + fc; fc; ^ 
sin (ttz) 



z—m+k+l 



, sn?' — !■ +00 

where iFi (a; b; c) the confluent hypergeometric series M6\ Equation 13.2.2]. 



Proof: The proof for the case fi ~ follows the steps in Appendix B-A with some minor modifications that 



have been reported in Appendix I-A Similarly, the proof for the case 7^ follows the steps in Appendix |B-B| 



with some minor modifications that have been reported in Appendix I-B Note also that i? = {0, 1, . . . , fc — 1}, 



A ~ and RA = \ {0, 1, . . . , fc — 1} in both vector Rayleigh and vector Ricean cases. ■ 

Note that the rates at which the average MMSE and the average mutual information tend to their infinite-snr 
values in the scalar channel model in and the vector channel model in ( |V.1[ ) are identical. In fact, the leading 
first-order term in the expansions of the quantities is identical but subsequent higher-order terms in the expansions 
may differ 

B. Low-snr Regime 

1) Discrete and Continuous Inputs: The generalization of the characterizations of the asymptotic behavior as 
snr — > 0+ of the average MMSE and the average mutual information for vector Rayleigh and Ricean fading 
coherent channels is also immediate. 

Corollary V.4. Consider a vector fading coherent channel as in ( |V. l| l driven by an arbitrary discrete input with 
flnite support or by oo-PSK, oo-PAM, oo-QAM or standard complex Gaussian continuous inputs, where h ^ 
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CM {lJi,2a'^Ik) with E C*^^^, and cr > 0. Then, in the regime of low -snr the average MMSE obeys: 

mmse (snr) ~ 

„.l|2\ 1 . ^. r(m ^^ 4-ic\ / lli,.l|2\ 

mmse^™' (z) 



exp 



/^II^A ^ /r. 2\™+l r (to + 1 + fc) ^ f 1 , , (rr,) 



2(7 



snr — )■ 0"*" 



z=0+ 



where iFi (a; &; c) /s f/ze confluent hypergeometric series [16 Equation 13.2.2]. 



Proof: The proof for the case /x = follows the steps in Appendix G-A with some minor modifications that 



have been reported in Appendix I-A Similarly, the proof for the case H ^ follows the steps in Appendix G-B 



with some minor modifications that have been reported in Appendix I-B 



Corollary V.5. Consider a vector fading coherent channel as in ( |V. l| l driven by an arbitrary discrete input with 
finite support or by oo-PSK, oo-PAM, oo-QAM or standard complex Gaussian continuous inputs, where h ^ 
CAf [lJL,2a^Ik) with fi E C*^^^, and cr > 0. Then, in the regime of low -snr the average mutual information obeys 
the expansion: 



I {snr) 



^ I 2cr2 ; + 1 ! ^ 



2 \ +°° 



(to + 1)! 



^+1 r(TO + i + fc) ^ / ^ , , Wnf 



mmse''"^^ (z) 



z=0+ 



where iFi (a; 6; c) is the confluent hypergeometric series l[16\ Equation 13.2.2]. 



Proof The expansion follows immediately from the expansion in Corollary |V.4| and the relationship in ( |III.8| l, 
together with the fact that an order relation can be integrated with respect to the independent variable llT4l . ■ 



snr — ^ 



VL Some MMSE Mellin Transform Results 
It has been established that the Mellin transform of the canonical MMSE given by: 

M [totosc; 1 + z] := / t'^mmse (t) dt, (VI.l) 

^0 

plays an important role in the definition of the high-snr behavior of the average MMSE and the average mutual 
information in fading coherent channels driven by a range of inputs. The objective now is to compute either 
analytically or numerically such a quantity for the most common input distributions, which when used in conjunction 
with the previous results, leads to concrete asymptotic expansions. 

A. BPSK and QPSK Inputs 

The MelUn transform of the canonical MMSE associated with binary phase shift keying (BPSK) and quadrature 
phase shift keying (QPSK) inputs can be obtained analytically. These results capitalize on the following Theorem. 
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Theorem VI. 1. Consider the canonical AWGN channel model in pi.7| l, where the input x is uniformly distributed 

over {-f , 1} with d > 0. Then, Vz G C : 7e (z) > 0, 

AI [mmse; 1 + z] = 

";2 + z;l 



<P(f^\ r(i + z) r(2 + 2z) ^ , ^i'- 



(1+20^ 



/^(1 + z) r(2 + z) ' 1 + 2Z 

where 2F1 {a,b;c;d) is the Gauss hypergeometric series 4761 Equation 15.2.1]. 

Proof: See Appendix |j] 
This Mellin transform can be immediately specialized for BPSK and QPSK inputs. 



Theorem VI.2. Consider the canonical AWGN channel model in ( |II.7| l driven by a standard unit-power BPSK 
input. Then, Vz G C : 7?. (z) > 0, 



/7r(l + z) r(2 + z) ' 1 + 21 



Proof: The result follows from Theorem VI. 1 and the fact that the input x is uniformly distributed over {—1,1}. 



Theorem VI.3. Consider the canonical AWGN channel model in ( |II.7| i driven by a standard unit-power QPSK 
input. Then, Vz G C : 7?. (z) > 0, 



Proof: The result follows from Theorem |VI.2| and the fact that the input x is uniformly distributed over 

{-71 71' +75 --^TS' +71 +^'71' +^75}' ^hi'^h i"^Pli^^ 

/■+00 /•+00 / i\ 

M [mmseQPS'^; ^ + A= j t^mmse'^^^'^ [t) dt = j emmse''^^'^ f | j dt = 2'+'M [mmse'^P^'^; 1 + z] 



B. Other Inputs 

The Mellin transform of the canonical MMSE associated with 4-PAM, 16-QAM, 8-PAM and 64-QAM inputs, 
for points zG H + ^iuiG {0, 1, . . . , 20}} has been obtained by numerical evaluation of ( |VI.1[ ). These results 
are summarized in Table H 
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TABLE I 

Numerical approximation of the Mellin transform of the canonical MMSE jVLTJ associated with 4-PAM, 16-QAM, 8-PAM 

AND 64-QAM INPUTS (Entries with - have not been computed) 





Input 


z 


4-PAM 


16-QAM 


8-PAM 


64-QAM 


1 
2 


2.04943 


5.79667 


5.30675 


1.50097 X 10^ 


- + - 
2^4 


2.88309 


9.69751 


1.03121 X 10^ 


3.46857 X IQi 


1 


4.34356 


1.73742 X 10^ 


2.18091 X 10^ 


8.72366 X 10^ 


1,3 
2^4 


6.91253 


3.28817 X 10^ 


4.91577 X 10^ 


2.33835 X 10^ 


3 
2 


1.15073 X 10^ 


6.50951 X 10^ 


1.16461 X 10^ 


6.588 X 10^ 


- + - 

2 ' 4 


1.98962 X 10^ 


1.33845 X 10^ 


2.87314 X 10^ 


1.93281 X 10^ 


2 


3.55419 X 10^ 


2.84336 X 10^ 


7.3338 X 102 


5.86704 X 103 


3,3 
2 4 


6.53372 X 10^ 


6.21596 X 10^ 


1.92794 X 10^ 


1.83418 X 10* 


5 
2 


1.23221 X 10^ 


1.39409 X 10^ 


5.20186 X 10^ 


5.88523 X 10* 


5,1 
2^4 


2.37821 X 10^ 


3.19972 X 10^ 


1.43672 X 10* 


1.93302 X 10^ 


3 


4.68794 X 10^ 


7.50071 X 10^ 


4.05343 X 10" 


6.48549 X 10^ 


5 1 3 
2^4 


9.42243 X 10^ 


1.79284 X 10-* 


1.16616 X 10^ 


2.21889 X 10'^ 


7 
2 


1.92833 X 10^ 


4.36331 X 10-* 


3.41629 X 10^ 


7.73017 X lO*' 


2^4 


4.01341 X 10^ 


1.07996 X 10^ 


1.01784 X 10^ 


2.73886 X 10' 


4 


8.48601 X 10^ 


2.71552 X 10^ 


3.08083 X 10*5 


9.85865 X 10' 


7,3 
2^4 


1.82117 X 10"* 


6.93041 X 10^ 






9 
2 


3.96371 X 10-* 


1.79377 X 10*5 






2^4 


8.7425 X 10-* 


4.70498 X 10*^ 






5 


1.95284 X 10^ 


1.24982 X 10'' 






9,3 
2^4 


4.41507 X 10^ 


3.36027 X lO'^ 






11 
2 


1.00974 X 10^ 


9.13912 X 10' 







VII. Numerical Results 

We illustrate the accuracy of the results by comparing the high-snr asymptotic expansions of the quantities to 
the numerical approximation, in a range of scenarios. 

Figures [T]-|6] consider the average MMSE and the average mutual information in Rayleigh, Ricean and Nakagami 
fading coherent channels driven by QPSK inputs. We observe that the expansions capture very well the high-snr 
behavior of the quantities. In particular, one concludes that it is possible to approximate the behavior of the quantities 
over a wider snr range by using several terms in the asymptotic expansions. We also observe that a single term 
expansion is sufficient to approximate well the high-snr behavior of the average MMSE and the average mutual 
information in channels subject to Rayleigh and Nakagami fading. However, expansions with a higher number of 
terms are necessary to approximate the high-snr behavior of the average MMSE and the average mutual information 
in channels subject to Ricean fading. This phenomenon, which is specially pronounced in the regime S> cr, is 
due to the fact that in such a scenario the behavior of the fading channel approaches the behavior of an AWGN 
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channel, where the average MMSE and the average mutual information tend to their infinite-snr values at rates 
greater than 2 and 1, respectively (see also ( |III.9[ ) and ( |in.lO| i). This can only be captured by incorporating more 
than a single term in the asymptotic expansions. 



1 term approx 
- 2 term approx 
" 3 term approx 





Fig. 1. Average MMSE in a Rayleigii fading coiierent cliannel 
driven by a QPSK input (cr = '^)- 



Fig. 2. Average mutual information in a Rayleigli fading 
colierent cliannel driven by a QPSK (ct = -75). 





Fig. 3. Average MMSE in a Ricean fading coherent channel 
driven by a QPSK input (|At| - ^ 



10 ™d<T= ^). 



Fig. 4. Average mutual information in a Ricean fading coherent 
channel driven by a QPSK input ~ 



10 ^"da= jig). 




5 20 




Fig. 5. Average MMSE in a Nakagami fading coherent channel 
driven by a QPSK input (/i = | and ui = 1). 



Fig. 6. Average mutual information in a Nakagami fading 
coherent channel driven by a QPSK input (/i = | and w = 1). 
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Figures |7] - [9] consider the average MMSE in Rayleigh, Ricean and Nakagami fading coherent channels driven 
by oo-PSK inputs. We also observe that the single-term expansions capture well the high-snr behavior of the 
quantities. 






Fig. 7. Average MMSE in a Rayleigli fading Fig. 8. Average MMSE in a Ricean fad- Fig. 9. Average MMSE in a Nakagami fad- 
coherent channel driven by oo-PSK input (cr = ing coherent channel driven by oo-PSK input ing coherent channel driven by oo-PSK {fj. = 

{\fJ-\ = and a = -^). § and «) = 1). 



VIII. Practical Applications 

We conclude by considering a problem of optimal power allocation in a bank of k parallel independent fading 
coherent channels driven by arbitrary discrete inputs, in order to showcase the application of the results. The channel 
model is given by: 

Vi ^ y/snrhi^iX^ + Hi, i^l,...,k (VIII.l) 

where y,; G C represents the i-th sub-channel output, Xi E C represents the i-th sub-channel input, hi is a complex 
scalar random variable with support C or C \ {0} such that i?^. < +oo which represents the random 

channel fading gain between the input and the output of the i-th sub-channel, and e C is a circularly symmetric 
complex scalar Gaussian random variable with zero mean and unit variance which represents standard noise. The 
scaling factor pi e represents the power injected into sub-channel i. The scaling factor snr e M+ relates to the 
signal-to-noise ratio. We assume that Xi,i — 1, . . . , k, hi,i = 1, . . . , k and ni,i — 1, . . . , k are independent random 
variables. We also assume that the receiver knows the exact realization of the sub-channel gains but the transmitter 
knows only the distribution of the sub-channel gains. This channel model is applicable to a OFDM and multi-user 
OFDM communications system ||T], ||2l. 

We denote the average MMSE and the canonical MMSE of sub-channel i in the model in ( |VIII. 1[ ) as mmsei (•) 
and mmsei {■), respectively. We also denote the average mutual information and the canonical mutual information 
of sub-channel i in the model in ( |VIII.l| i as li (•) and (•), respectively. 

The objective is to determine the power allocation policy that maximizes the constrained capacity given by: 

fe 

I{snr;pi, . . . ,pk) = {snr ■ p^) 

i=l 
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subject to a total power constraint: 

k 

i=l 

and > 0, i = 1, . . . , fc. The following Theorem, which is based on the asymptotic expansions put forth in the 
previous sections, defines the optimal power allocation policy in the asymptotic regime of high snr for Rayleigh 
and Ricean fading models. 

Theorem VIII.l. Consider a bank of k parallel independent Rayleigh or Ricean fading coherent channels as 
in ( |VIII.l| l driven by arbitrary discrete inputs with finite support, where hi ^ CM (^Hi, 2cr|) with jii = Q or fXi ^ 0, 
respectively, and (7^ > 0, i = 1, . . . , /c. Then, in the regime of high snr the optimal power allocation policy obeys: 



/exp ■ ^ " ^ + 0[ , snr ^+00, 

2af I 2a j Xsnr \ snr 



where A is such that X]i=i Pi — 



Proof: See Appendix [K] 



Theorem |VIII.1| reveals the impact of the nature of the fading distribution and the input distribution on the 
high-snr optimal power allocation policy. In Rayleigh fading channels, given equal sub-channel inputs, it can be 
seen that the higher the average sub-channel strength (i.e., the higher 2cr|) then the lower the allocated power. In 
Ricean fading channels, it can also be seen that the presence of line-of-sight components affects dramatically the 
power allocation policy. It is interesting to note that, as expected, the nature of the inputs affects the optimal power 
allocation policy via the Mellin transform of the canonical MMSE. It is also interesting to note that the power 



allocation policies embodied in Theorem VIII.l in fact represent a generalization of the power allocation poUcy 



put forth in [2|, in the sense that - in the single-user setting - it applies to Ricean fading in addition to Rayleigh 



fading and to scenarios where the different input signals conform to different discrete constellations. Figures 10 



and 1 1 confirm that the optimal power allocation rapidly converges to the high-snr power allocation uncovered by 



Theorem | VIII. 1 1 for a bank of two parallel independent fading coherent channels. 
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Fig. 10. Optimal and asymptotic power allocation in a bank 
of two parallel independent Rayleigh fading channels (2af = 4 
and 2cr| = 1). First sub-channel driven by equiprobable unit- 
power 16-QAM and second sub-channel driven by equiprobable 
unit-power QPSK. 



Fig. 11. Optimal and asymptotic power allocation in a bank of 
two parallel independent Ricean fading channels (pi = 1 + i, 
2(Tj = 4, /i2 = 1 + * and 2(t| = 1). First sub-channel driven by 
equiprobable unit-power 1 6-QAM and second sub-channel driven 
by equiprobable unit-power QPSK. 



IX. Conclusions 

Motivated by the need to understand the behavior of the constrained capacity of fading channels, we have unveiled 
asymptotic expansions of key estimation- and information-theoretic measures in scalar and vector fading coherent 
channels, where the receiver knows the exact fading channel state but the transmitter knows only the fading channel 
distribution, driven by a range of inputs. In particular, we have constructed low-snr and - at the heart of the novelty 
of the contribution - high-snr asymptotic expansions for the average minimum mean-squared error and the average 
mutual information for coherent channels subject to Rayleigh fading, Ricean fading or Nakagami fading and driven 
by arbitrary discrete inputs (with finite support) or by oo-PSK, cx)-PAM, oo-QAM, and standard complex Gaussian 
continuous inputs. The most relevant element for the construction of the asymptotic expansions is the realization that 
the integral representation of the measures can be seen as an /i-transform of a kernel with a monotonic argument. 
This paves the way to the use of a range of expansion of integrals techniques, most notably, Mellin transform 
methods, that yield the asymptotic expansions for the average minimum mean-squared error and - via the now 
well-known I-MMSE relationship - for the average mutual information. 

We have also considered as a case study a standard power allocation problem over a bank of parallel independent 
fading coherent channels driven by arbitrary discrete inputs, a scenario representative of orthogonal frequency 
division multiplexing communications systems. In particular, we have illustrated how to determine the power 
allocation policy that maximizes the constrained capacity of the bank of parallel independent fading channels 
in key asymptotic regimes. 

Appendix A 
Proof of Theorem IIII.1I 

Let 

,,,, Vtfm (Vt) 
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h (t) := mmse (t) 

Then 

r+oo 

mmse (snr) = {|/ipmmse (snr|/ip) } = / f [u) h [snru) du (A.l) 

We note that is an /i-transform with Kernel of Monotonia Argument, so that we can capitahze on the 

method of Mellin transforms [14', Section 4.4] to obtain the asymptotic expansion of mmse {snr) as snr +oo 
via ||T41 Theorem 4.4]. The application of 1141 Theorem 4.4] requires that: 

1) Both h{-) and / (•) are locally integrable functions on M+; 

2) The following holds true 

a) The function h{-) decays as 

+00 N(m) 

h {t) ^ exp (-fcr) Crnni-"" (log {t)T , t ^ +00 (A.2) 

m— n— 

where TZ (k) > 0, v > 0, Cmn G C, 7?. (r,„) ^ +oo and N (m) is finite for each m. 

We note that in the case k ^ a small modification of the proof of llT4l Lemma 4.3.1] also yields the 

conclusions in llT4l Theorem 4.4] if instead of ( |A.2| l we have 

= 0(exp(-/cr)), t-)-+oo 

where 7^ (fc) > and v > 0. 

We also note that in the case fc = 0, if it suffices to obtain an asymptotic expansion with a finite number 
of terms then the proof of 11141 Lemma 4.3.3] also reveals that we obtain the same conclusions in llT4l 
Theorem 4.4] if instead of ( |A.2| l we have 

Mh N{Tn) 

h{t)=Y^ E (l°g (^))" + O {t^''"^^' (log {t)f^'''^+'^) , t^+oo (A.3) 

m— n—0 

where Mh < +oo and N (m) is finite for each m. 

b) The function / (•) decays as 

+00 N{m) 

/ (t) ^ cxp {-qt-^^) J2 E (log (*))" ' * ^ 0^ (^-4) 

m— n—0 

where TZ (q) > 0, fi > 0, p„j„ E C, TZ (a,„ ) t +oo and (to) is finite for each to. 

We note that in the case q ^ a small modification of the proof of iTHl Lemma 4.3.4] also yields the 

conclusions in |[l4l Theorem 4.4] if instead of ( |A.4| i we have 

/(i)-O(exp(-gt-^)), t^0+ 

where TZ{q) > and /i > 0. 

We also note that in the case q = 0, if it suffices to obtain an asymptotic expansion with a finite number 
of terms then the proof of llT4l Lemma 4.3.6] also reveals that we obtain the same conclusions in llT4l 
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Theorem 4.4] if instead of ( |A.4| i we have 

Mf N(m) _ 

/ (i) = E E (l°g + O (*""'^' (log (t))^(*'^+^)) , t ^ 0+ (A.5) 

m— n— 

where Af/ < +oo and (m) is finite for each m. 

3) Let 

a := inf |a* ■.h{t)^0 (i""*) ,i ^ 0+| 

/3 := sup|/3* ■.h{t) = {t^^^') ,t^+oo^ 

7:=inf{7* :/(i)-o(t-^'),i^O+} 

(5 :=sup|r : f{t) = {t-^'^ ,t ^ +00} 

We require that a < j3 and 7 < 5, so that M [h; z] and M [/; z] are holomorphic in the strips a < TZ ( z) < (3 
and 7 < 7?. (2;) < (5, respectively, |14, p. 106]. 

4) Let 

C:={zeC:{a<n{z)<(3)A{l-5<n{z)<l-j)} 

We require that 
so that 

G (z) M [/i; z] M [/; 1 - z] 

is holomorphic in C (which is then continued to the right as a meromorphic function at worst ifMl p. 118]); 

5) The following holds true 

(/•+00 1 i-c+ioo \ 

/ f {t)h{t)dt= — I G(z)dzAVx e [c,+cx)[, lim G (x + iy) = (A.6) 

6) The following holds true 

a) If fc 7^ A (7 7^ 0, then we require that there exists a real sequence u„ such that ii„ t +00 and 
Vn e Z+, |G (u„ + iy)\ dy < +00; 

b) If fc 7^ A (7 = 0, let [/ := {TZ (a,„) + 1 : m G Z+} and let u„ be the real sequence such that u„ t +C!0 
and [/ = {un : n G Z+}. Then we require that Vn G Z+, 3x g]m„, Mn+i[: /J*^ \G {x + iy)| dj/ < +00; 

c) If /c = A g 7^ 0, let := {7?. (rm) ■ rn G Z+} and let u„ be the real sequence such that m„ t +C)o 
and = {un : n G Z"^}. Then we require that Vn G Z+, 3x g]u„, Un+i[: /J*^ \G {x + «y)| dy < +00; 

d) If /fc A g = 0, let := {7^ {a„,) + 1 : to G Z+} U {7^ {r„,) : to G Z+} and let -it„ be the real 
sequence such that m„ f +00 and T4^ = {u„ : rt G Z+}. Then we require that Vri G Z+, 3a; G]u,i, Un+i [: 
/+^|G(x + zy)|dy<+oo; 

We note that in the case ( |A.3| ) and/or ( |A.5| l the real sequence u„ must be replaced by the finite list {u„ : 
Un < min{7^ (rM^+i) , 7^ (oa/^+i) + !}}■ 
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The asymptotic expansion of ( |A.l| l as snr — > +00 is then given by lfT4l Theorem 4.4]: 

/ f (u) h (snru) du — — res{snr^^G (z)} (A. 7) 

(where c is as in ( |A.6| ) and does not need to be unique, and res{snr~^G (z)} denotes the residue of the meromorphic 
function snr^'G{-) at z |18|) which can be written more explicitly by using N (m), Cmn, I'm, N {m), p„m and 
flm as well as by identifying the appropriate scenario, i.e., ky^OAqy^O, ky^OAq^O, k = 0/\qy^O 
OT k — A q = 0. We note that in the case ( |A.3[ ) and/or ( |A.5[ ) the sum in ( |A.7| i will be taken with respect to 
c < 7^ (z) < min{7?. (rM^+i) , Tl (flA/^+i) + 1} instead of with respect to c < 7?. (z). 

Proof of Theorem We now establish the requirements [T]|6] for the application of the Mellin transform 

method. 

The function / (•) is locally integrable on M+ because of the hypothesis < +00 which ensures that 

a<b^ [ f{t)dt^ ( ^•^1"! (^) rft^ 1^ u^f\h\{u)du< r u^f\^iu)du^Eh{\h\''} <+c^ 

The Mellin transform M [/; z] converges absolutely and is holomorphic in the strip 'y < TZ {z) < S because of 
hypothesis ( jllOl l lfT4l p. 106]. 

The function h{-) is locally integrable on IR+ and the Mellin transform M[h;z] converges absolutely and is 
holomorphic in the strip Tl{z) > because of 

h{0)<+oo (A.8) 

Vi e M+,/i(t) > (A.9) 

yt eR^,h' (t) <0 (A. 10) 

h (t) ^ O ( exp ( -'^t]\ (A.ll) 



4 _ 

where d > denotes the minimum distance between the elements of the support of the input distribution Q |[T] 
Theorem 4]. Hence, requirements [T] and [3] are satisfied. 

Requirement |2] is ensured by hypothesis ( |III.2| l and ( |A.ll| l. 

Requirement |4] is ensured by hypothesis ( |III.4[ l. 

Combining 

M [/; 1 - c - iy] G (-00 < y < +00) 

(which is true due to hypothesis ( |III.5| l and the fact that 7\f [/; 1 — c — iy] is holomorphic in the line ]c~ioo, c+ioo[) 
with 

t''-'^h{t) eL^ {0<t< +00) 
(which is true due to ( jAiSj l, ^A3\ , ^AAU[ , (|ATT) and 7^ C C M+) it is clear Ql P- 108] that 

f{t)h{t)dt=— G{z)dz 
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Combining hypothesis ( |III.5[ ) with 



\/x eR+,M[h;x + iy]=o{l), |y| ^ +c 
(which is true because M [h; z] is holomorphic in the strip TZ (z) > 0) yields 

yxe[c,+cx[,Gix + iy) = 0{\y\-^), \y\ ^ 

which in turn implies 

Vx e [c, +00 [, lim G {x + iy) = 

|'y|-i-+oo 



as well as (note that ( |A.ll| i implies that fc 7^ 0) 

• If k ^ Q /\ q ^ Q, there exists a real sequence u„ such that w„ f +00 ^nd - because Vn S Z"*" , G (u„ + iy) is 
holomorphic in the line ]u„ — icx), w„ + ioo[ - Vn G Z+. /I*^ |G (m„ + iy) \ dy < +00, 

• If fc 7^ A g = 0, let [/ {TZ + 1 : m e Z+} and let w„ be the real sequence such that u„ t +c» and 
[/ = {u„ : n e Z+}. Since Va; g]u„, w„_|_i [, G (x + iy) is holomorphic in the line ]x — ioo, x + ioo[, we have 
that Vn G Z+, Bo; e]tt„, Un+i [: /J^^ |G (a; + < +00. 

Hence, requirements |5] and [6] are satisfied. 

These established requirements lead immediately - via ( |A.7| l - to the expansions: 

• If q = then 

mmse (snr) ^ 

+00 7V(m) 



mmse; z\ 



m— 

If g 7^ then 



2 — I + Ot, 



Vi? G M^, mmse {snr) = o (^snr^^'^ , snr — > +00 



-00 



Appendix B 
Proof of Corollary IIII.2I 



A. Case fj, = 

Since, by Taylor's Theorem ifTSl . 



we have that requirement ( |ni.2| i holds with 

q^O, N{m) ^ 0, p,„o 



+00 / N m 

(-1)™ 



i\ (2a2) 



m+l ■ 



a,„ = m + 1 



Since, the Mellin transform of / (•) 

f +00 

M[/;z 



t"-i-^exp ( --^ )dt - (2(72)"r(z + 1) < +00 
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converges absolutely and is holomorphic in the strip Tl{z) > —1 [Td, Equation 5.2.1], we have that 7 = — 1 and 
6 = +00 which satisfy 7 < (5 and ]0, +oo[n]l ~ 6,1 ~ 7[=]0, +cx)[n] - cx), 2[=]0, 0, i.e., requirements ( |III.3| ) 
and ( |III.4| l are satisfied. Also, since lHH p. 138] 



VxeM,r(x + Z2;) = 0(Gxp(-(^--e) \y\]], I2/I ^ +00 



TT 



where e is any small positive real number, we also have that 

A 



V.T e +(X)[, Af [/; 1 - X - iy] - O (Ij/r^) , \y\ +CX) 



i.e., we also have requirement ( |III.5| l. 

The result now follows from Theorem IIII.ll 

B. Case 7^ 
Since 



k 



= exp 



where the second equality is due to the definition of the modified Bessel function of the first kind lfT6l Equation 
10.25.2], we have that requirement pil.2| i holds with 



Since, the Mellin transform of / (•) 



t ( ( t 







|2\ . / / I, ,12 



^ V 2cr2 y V ^ ^ I Y{z + l) ^ r (1 + n n\ 

\ / \ / n— 



October 17, 2012 



DRAFT 



35 



exp (^-MJ^ {2aYr{z + l)^F,(^z + l;l; 



2^2 



< +00 

where the third equahty is due to the definition of the modified Bessel function of the first kind [16' Equation 
10.25.2], the fourth equahty is due to Fubini Theorem 1 251 Theorem 6.5], the fifth equahty is due to TZ (z) > 
— 1 which imphes Vn e Zq,TZ{z) + n > —1 and the sixth equahty is due to the definition of the Confluent 
hypergeometric series lfT6l Equation 13.2.2], converges absolutely and is holomorphic in the strip TZ{z) > —1, we 
have that 7 = -1 and S = +co which satisfy 7 < 5 and ]0, +oo[n]l - 6,1 - "/[=]0, +oo[n] - 00, 2[=]0, 0, 
i.e., we satisfy requirements ( |III.3| ) and ( |III.4| l. 

It is now important to examine the asymptotic behavior of the Mellin transform of / (•). We can conclude from 
( |B.l| i that / (•) is infinitely continuously differentiable on M. We can thus also conclude - in view of the fact that 
the power series ( |B.1[ ) has infinite radius of convergence - that /'^-'' (•), j — 1.2, .. . is given by term-by-term 
differentiation of ( |B.l| l ifTSl p. 74]. This leads to the fact that 

is a finite sum where the terms are given by a constant, times a power of t (namely, with y S M), times 
exp (—25^) ™d times Iq ^ ^2^^ ^ and/or a derivative of Io{t) evaluated at < = ^2^^ , and together with lfT6l 
Equation 10.29.5] 

4''^ (^) = ^ (iv-k (z) + Q)4-fc+2 (z) + {z) + ---+ {z)^ 

and ins Equation 10.40.1] 



exp(z) ^ . _,.fe afe(w) 

Iv{z) rV(-l — I—, z->-+<x 

i^nzr to 



where ^ Equation 10.17.1] 



(4t-2 - 12) (41,2 - 32) . . . (4«2 - {2k - if) 
ao (w) = 1 fc > 1 ^ afe (v) = ^ ^ 



to the fact that 



fc!8* 



i{t,x,p) ^ 0{exp{-k{p)t)) , t ^ +c 



where Vp e fc (p) > 0. 

We have now established that / (t) is infinitely continuously differentiable on M+, that 



+00 



m=0 



where TZ{a„i) ^ +00, that the asymptotic expansion of /'^■'' {t),j — 1,2,... as t 0+ is obtained from the 
asymptotic expansion of / (•) by successively differentiating term-by-term, and that g {t,x,p) vanishes as i — > +00 
for p = 0, 1, . . . and x > —TZ (ao). This implies |14, Corollary 6.2.3] that 

Vi? e R+,yx e R,M[f;x + iy] = O {\y\^^) , \y\ -> +00 
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where M [f;x + iy] is to be understood as the analytic continuation of M [f;x + iy] from {x + iy : 1 — S < x < 
1 — 7} to the entire z plane ifTSl p. 181] and hence that 

e +(X3[, M[f;l-x~ iy] = O {\y\-^) , \y\ ^ +cx) 

i.e., requirement ( |III.5[ ). 

The result now follows from Theorem IIII. 1 1 

Appendix C 
Proof of Corollary IIII.3I 

Since, by Taylor's Theorem ifTSl . 

2 1 {^) \ w / 1 [II) m\w™ 

we have that requirement ( |III.2| l holds with 



g = 0, iV(m) = 0, p„^o^—— — , ^ m + ^ 



Since, the Mellin transform of / (•) 







converges absolutely and is holomorphic in the strip TZ{z) > —/it lfT6l Equation 5.2.1], we have that 7 ~ — /i and 
S = +00 which satisfy (in view of the fact that /i > i) 7 < (5 and ]0, +oo[n]l — 5,1 — 7[=]0, +oo[n] — 00, /i + 
]0, +oo[n] - 00, |[=]0, §[7^ 0, i.e., requirements ( |III.3| l and ( |III.4| ) are satisfied. Also, since OH p. 138] 

Va;eM,r(a; + z2;) = o(exp(-(|-6) , ^ 

where e is any small positive real number, we also have that 

Vx e +oo[, M[f;l-x- iy] = O {]y]-^) , ]y] ^ +cx) 

i.e., we also have requirement ( |III.5| l. 

The result now follows from Theorem IIII. 1 1 

Appendix D 
Proof of Theorem IIII.6I 

Let 

Vtfw (^) 

h (t) :— mmse (t) 
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Let also n,M e Z^j" and a; G ■ We have that 



tn-1 i-t 



+00 ^ +00 

-|^\Jl+l f + CO 



h (tn+l) dtn+ldtn ■ ■ ■ dt2dti 



00 J +00 



h (t) {t - x)" dt 



(-1) 



Jl+l p + OD 



h{t + x) t"-dt 



(D.l) 



where in the first equality we use ( |III.15| l and in the second equality we use lfT6l Equation 1.4.31] and hence that 



(- 


1)"+^ 




nl 


1 


r+oo 

L • 


nl 




1 


p + CO 


n! 


L ' 



h{t + x) t"dt 

h{t + x) f-dt 
h (t) edt 



1 



n 

< +00 



I AI [h; n + l] 



(D.2) 



where the second equality and the first inequality are due to ( |A.8| l, ( |A.9| l and ( |A.10| i and the second inequality has 
been justified in Appendix |A] We also have that 



i;-i.O+ 



(- 


1)"+^ 




nl 


(- 






nl 


(- 




nl 



lim 



h{t + x) f^dt 



lim (h{t + x)r)dt 



h (t) rdt 



(0) 



(D.3) 



where the first equaUty is due to ( |D.l[ l and the second equality is due to ( |D.2| l and to Lebesgue Dominated 
Convergence Theorem ||251 Theorem 5.8]. One can now use ( |D.2[ ) and ( |D.3| l with the set of hypotheses ( |III. 
PI.12| ) and piI.13| ) to conclude that 

Vsnr e M+, 3 lim /("^ (<) /i*""-!) (snrt) = 



Vsnr e M+, 3 lim (t) /i^""-!) (snrt) < + 



00 



-f CO 



(t) h'--''-'^^ (snrt) dt^O (1) , snr +00 
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This leads immediately - via integration by parts - to the asymptotic expansion given by 

mmse (snr) — 

= {\h\'^mmse (snr|/ip) } 

+00 

/ (u) h (snru) du 







I i\ni _ -+00 / TxM+l p+00 



m=0 
M 



y /(™) (t) (snrt) + ^At-t / /'*'+'^ (t) (snrt) dt 



{—\\ r n +00 

V '-- /(™) (t) /i^-"-!) isnrt) 



m=0 

, (-1) 





M+1 ,.+00 



snr' 



/ r n +00 /■+00 \ 

m— 

/I \-^^+2 / /'+00 \ 

+ L^i— ( (0) h^-''-^^ (0) + / (t) (snri) ) 

m=0 ^ ^ 

+00 / \m+l 

^ E l+i /^"^ (0) /^'"""'^ (0) , snr ^ +00 

m=0 

Appendix E 
Proof of Theorem IIII.7I 

Let 

Vtfw (^) 

/i (t) mmse (t) 

r+oo 

mmse{snr) = {|/ipmmse (snr|/ip) } = / J [u) h [snru) du (E.l) 

"'0 

We note that ( |E. l| l is also an ^.-transform with Kernel of Monotonic Argument, so that we can capitalize on the 
method of Mellin transforms 114. Section 4.4] to obtain the asymptotic expansion of mmse [snr) as snr — > +00 
via OH Theorem 4.4]. 

We now establish the requirements for the application of the Mellin transforms method. 

A. Case: x ^ 00-PSK, x ~ 00-PAM or x ^ 00-QAM 

We can establish that / (•) is locally integrable on M+ and that M [/; z] converges absolutely and is holomorphic 
in the strip j < TZ{z) < 6 hy capitalizing on { \h\^} < +00 and hypothesis ( |III.23| l, respectively, as we did in 
Appendix |a] We now extend M [/; z] to the left of the strip: consider the two cases q = and q ^ 0: 



Then 
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1) Case <? = 0: In this case we have lfT4l Lemma 4.3.6] that M [/; 1 — z] can be analytically continued as a 
meromorphic function from 1 — (5<7?.(z)<l — 7 into Tl{z) > 1 — 5 with poles at z = am + 1 for every 

TO G 

2) Case q ^ 0: In this case we have lfT4l Lemma 4.3.4] that M [/; 1 — z] can be analytically continued as a 
holomorphic function from 1 — (5<7?.(z)<l — 7 into 7?. (z) > 1 — (5. 

We can also establish that h (t) is locally integrable on M+ because h (•) is continuous on Rq and that M [h; z] 
converges absolutely and is holomorphic in the strip < 7?. (z) < 1 for 00-PSK, 00-PAM and oo-QAM because of 
(A^ , ^A3} and ^AAO^ , and of ^17}, ( |!IlT8] i and ^19}, i.e., of 

h {t) = Ci"''" + O {r''' ), 



(E.2) 



where 



^ > 2 



1 



ro :=1 



^ ' 2 



3 
^. 2 



00-PSK 
00-PAM 
oo-QAM 



00-PSK 
00-PAM 
oo-QAM 

We now extend M [h: z] to the right of the strip: indeed, it can be fT?, Lemma 4.3.3] analytically continued as a 
meromorphic function into < TZ (z) < ri with a pole at z = rg. 

Note that hypothesis ( |III.21| i and ( |E.2| i ensure a "correct" type of decay. 

Note also that hypothesis ( |III.24[ ) ensures that the function G {■) := M [h; ■] M [f;l — ■] is holomorphic in 
C :~]Q, l[n]l — (5, 1 — 7(7^ 0. Note also that G (•) can be analytically continued: consider the two cases q = and 

1) Case 9 = 0: The function G (z) can be analytically continued as a meromorphic function from G into 
max{0, 1 — 6} < TZ (z) < min {TZ (oo) + 1, J'l} because tq = 1 and by hypothesis ( |III.22| i and TZ (a„j) '[ +00 
implies that TZ (om) + 1 > tq. 

2) Case q ^ 0: The function G (z) can be analytically continued as a meromorphic function from G into 
max{0, 1 - (5} < 7^(z) < ri. 

Combining 

M [/; 1 - c - iy] € (-00 <y < +00) 

(which is true due to hypothesis ( |III.25[ l and the fact that M [/; 1 — c — iy] is holomorphic in the line ]c— ioo, c+ioo[) 
with 

f'-^hit) eL^ {0<t< +00) 
(which is true due to ( jAiSj l, ([A^, ( |A101 i, (|E2| and 7^ G C]0, 1[) it is clear that 01 P- 108] 



+ CXD 



fit) hit) dt = 



2TTi 



c+'i 00 



G (z) dz 



Combining hypothesis ( |III.25| l with the fact that 
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1) Case g = 0: 

Vx G [c, min {TZ (ao) + 1, ri} M [h; x + iy] — o{l) , |y| ~> +oo 
we conclude - due to 7^ C C]0, 1[ - that 

Vx e [c, min {7^ (ao) + 1, ri} [, G (x + iy) = O (lyl^^) , |?/| ^ +00 
which in turn implies that 

Vx e [c, min {7?, (ao) + 1, ri} [, lim G {x + iy) — 

\y\-f+oo 

and that 

r+oo 

Va; e]ro, min{7^ (ao) + 1, ri} [, / \G {x + iy)\ dy < +00 



The fact that the requirements for the application of the Mellin transform method are met leads to the 
expansions 11141 Theorem 4.4]: 

mmse (snr) ~ ^ + O ( ^ ] , snr ^ +00, Vi? g]1, min {7?. (ao) + 1, ri} [ 



2) Case q ^ 0: 

yx e[c,rilM[h;x + iy]=o{l), |y| ^ +00 
we conclude - due to 7^ C C]0, 1[ - that 

Vxe [c,rilG{x + iy)^0{\y\-'^) , |y| ^ +00 

which in turn implies that 

Va;e[c, ri[, lim G {x + iy) — 

Ij/l-f+oo 

and that 

r+oo 

Vx e]ro, ri[, / \G (x + iy)\ dy < +00 



The fact that the requirements for the application of the Mellin transform method are met leads to the 
expansions iT4l Theorem 4.4]: 

mmse (snr) ^ ^ + O f =^ | , snr — > +cx), Vi?e]l,7'i[ 



B. Case: x-C7V(0,l) 

This proof follows the steps of the previous proof The difference is that we use pil.20| l 

1 11 

h{t) = _ = -_ ^ ^ t ^ +00 (E.3) 

t m— 

and m p. 123] 

M [h; z] = (E.4) 
sm (ttz) 

Hence, the Mellin transform M [h; z] converges absolutely and is holomorphic in the strip < 7?. (z) < 1, and can 
be analytically continued from < 7?. (z) < 1 to the entire complex plane via ( |E.4| l. 

We note that, in this case, we have capitalized not only on l(T4l Theorem 4.4], but also on lfT4l Exercise 4.16]. 
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Appendix F 
Proof of Theorem IIV. II 

Let 

/i (t) :— mmse (t) 
it) ^MZ|M 

snr 

Then 

/■+00 r+oo 

mmse (snr) = £'1^1 {|/ipr7imse (s7ir|ft,p) } = / hi [u] fi (snru) du = X / fx{u)hi[\u)du (F.l) 

JO Jo 

snr — 0^ A — > +00 

We also note that ( |F.l| i is an /i-transform with Kernel of Monotonia Argument, so that we can also capitalize on the 
method of Mellin transforms 1141 Section 4.4] to obtain the asymptotic expansion of mmse (snr) as snr 0+ or 
A +00. 

We now establish the requirements for the application of the MelUn transforms method. 

We showed in Appendix [a| (for discrete inputs) and in Appendix |e] (for the continuous inputs) that hi (t) and /i (t) 
are locally integrable functions on M+. We also showed in Appendix [a| and in Appendix [e] that M [/i; z] converges 
absolutely and is holomorphic in the strip Tl{z) > (for discrete inputs) and in the strip < 7?. (z) < 1 (for the 
continuous inputs) and hence that M [/i; 1 — z] converges absolutely and is holomorphic in the strip TZ{z) < 1 
(for discrete inputs) and in the strip < TZ (z) < 1 (for the continuous inputs). The Mellin transform A/ [hi; z] also 
converges absolutely and is holomorphic in the strip ai < TZ (z) < f3i because of hypothesis ( |IV.2[ ) 114., p. 106]. 

Note hypothesis ( |I V. 1 [ ) and 



+00 ^ 

/i (t) = V — ,mmse(") (z) 
^-^ m' 



m=0 

+ C30 



=0+ 



Y.Pmt''"^ t^0+ (F.2) 



m=0 



(which is true because the fact that the input has finite moments implies that the function fi (t) is infinitely right 
differentiable at i = 17] Proposition 7] which enables a straightforward application of Taylor's Theorem |18|) 
which ensures a "correct" type of decay. 

Note hypothesis ( |IV.3| l which ensures that the function Gi (•) :— AI [hi; ■] M [fi; 1 — •] is holomorphic in Ci 7^ 0. 

Combining 

M [hi;ci + iy] G (-00 <y < +00) 

(which is true due to hypothesis ( |IV.4[ ) and the fact that M [hi ; ci + iy] is holomorphic in the line ]ci — loo, ci +ioo[) 
with 

t-^'fi {t) eL^{o<t< +00) 
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(which is true due to 7^ Ci C] — 00, 1[ (for discrete inputs) or 7^ Ci C]0, 1[ (for the continuous inputs), ( |A.8| l, 
( |A.9| l, ( |A.10| i and ( |A.ll| i (for discrete inputs) or ( |E.2| i and ( |E.3| l (for the continuous inputs)) it is clear that lfT4l 
p. 108] 

Jo ^""^ Jci-ioo 

Combining hypothesis ( |IV.4[ ) with 

M[/i;l-a:-i2/] =0(1), |2/| ^ +00 

(which holds Vx G M (for discrete inputs) or Vx G (for the continuous inputs) lfT4l Lemma 4.3.6]) where 
M [fi;l — X — iy] is to be understood as the analytic continuation of M [fi;l ~ x — iy] from {x + iy : x < 1} 
(for discrete inputs) or from {x + iy : < x < 1} (for the continuous inputs) to the entire z plane (for discrete 
inputs) or to the strip {x + iy : x > 0} (for the continuous inputs) |18 , p. 181] yields 

Va; G [ci, +oo[, G {x + ly) = O {\y\-^) , \y\ +00 



which in turn implies 



Vx G [ci, +cxd[, lim G {x + iy) = 

\y\^+oo 



as well as (note that ( |IV.1| ) implies that fci 7^ and that ( |R2] l impHes that qi = 0) if U := {TZ (am) + 1 : rn G Z+} 
and Un is the real sequence such that u„ t +00 and U = {ii„ : n G Z+} then, since \/x g]u„, u„+i[, G (x + iy) is 
holomorphic in the line ]x — ioo, x + ioo[, we have that Vn G Z+, 3a; g]u„, Un+i[- \G {x + iy)\ dy < +00. 

This leads immediately to the expansions lfT4l Theorem 4.4., Case II]: 

+00 

mmse (snr) ~ pmM[hi; am + IJA""", A +00 



m=0 

+ C30 



V ^M[/ii;m + l]mmse('") (z) 



m! 

m=0 



snr 

z=0+ 



snr — >■ 0^ 



Appendix G 
Proof of Corollary IIV.2I 



A. Case fi — 
Since 



where TZ (ki) > and vi > 0, we have that requirement ( |I V. 1 [ ) holds. 



Since, we showed in Appendix B-A that the Mellin transform of hi (•), which is given by 

M[hi;z] = (2a^)" r {z + 1) , 
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converges absolutely and is holomorphic in the strip Tl{z) > — 1, we have that ai = —1 and /3i = +oo, which 
satisfy ai < f3i, and 

]ai,/3i[n] - oo, 1[=] - 1, +oo[n] - oo, 1[=] - 1, if x is discrete, 
]ai,/3i[n]0, IH - l,+oo[n]0, IHO, 1[7^ if x is continuous, 

i.e., we satisfy requirements ( |IV.2[ ) and ( |IV.3| l. 



We also showed in Appendix B-A that 



Vx e +oo[, M [hi;x + iy]^0 {\y\-^) , |y| ^ +c 



i.e., we satisfy requirement ( |IV.4| l. 

The result now follows from Theorem II V. 1 1 

B. Case ^ 
Since 

Vifm (Vt) 



hi it) 



2 

t ( IH'A ( t \ fVtv 



27r4^ ) ■ fc=o 



= 0(exp(-fcit^i)) , t^+oo 

where the asymptotic expansion is due to lfT6l Equation 10.40.1], TZ (fci) > and vi > 0, we have that requirement 
( |IVT] | holds. 



Since, we showed in Appendix B-B that the Mellin transform of hi (•), which is given by 

M[/ii; z] = exp (^-M!^ (2a'Y r (z + 1) iFi (^z + 1; 1; , 

converges absolutely and is holomorphic in the strip TZ{z) > — 1, we have that ai — —1 and /3i = +oo, which 
satisfy ai < /3i, and 

]ai,/3i[n] - CXI, ![=] - 1, +oo[n] - oo, 1[=] - 1, if x is discrete, 

]ai,/3i[n]0, ![=] - l,+oo[n]0, IHO, 1[7^ if X is continuous, 

i.e., we satisfy requirements ( |IV.2[ ) and ( |IV.3| l. 



We also showed in Appendix |B-B| that 



Vx e[^,+oo[,M[hi;x + iy]^0{\y\ ^) , Kj| ^ +oo 



i.e., we satisfy requirement ( |IV.4| l. 

The result now follows from Theorem IIV. 1 1 
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Since 



Appendix H 
Proof of Corollary IIV.3I 



it) := ^^MM = -P (- 5^ ) = O (exp (-fc.rO) , t 



where TZ (ki) > and vi > 0, we have that requirement ( |IV. 1[ ) holds. 

Since, we showed in Appendix [c] that the MelHn transform of hi (•), which is given by 



converges absolutely and is holomorphic in the strip TZ (z) > — /i, we have that ai — — /i and /?i = +00 which 
satisfy ai < f3i because > ^ and 

]ai,/3i[n] - 00, 1[=] - ^, +oo[n] - 00, l[D] - i +oo[n] - cxi, 1[=] - i if a; is discrete, 



]qi, /3i[n]o, iH - +c»[n]o, i[d] - i, +c»[n]o, iHo, 

i.e., we satisfy requirements ( |IV.2[ ) and ( |IV.3| l. 
We also showed in Appendix |C] that 



i.e., we satisfy requirement ( |IV.4| l. 

The result now also follows from Theorem IIV. 1 1 



if X is continuous. 



Appendix I 
Proof of CorollaryIV. II 



A. Case (1 = 



The proof follows the steps of Appendix B-A taking into account that now: 



2t2'^-iexp 



f\M it) 



20-2 



(2cr2)'=(A:_i)! 



By Taylor's Theorem ifTSl we have that 



+00 



fa)^y tlT 



m+A: 



+ 



We also have that 



^ , (2a^)"r{z + k) 
M[f- z] = ^ < +00 



ik~l)l 

converges absolutely and is holomorphic in the strip TZ{z) > —k lfT6l Equation 5.2.1]. 
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B. Case ^ 



The proof follows the steps of Appendix B-B taking into account that now 

/|IMlW-ppT^exp^-^jexp(^-- ^" 
By Taylor's Theorem 1181 and 1161 Equation 10.25.2] we have that 

2 \ +°o " / /I N^-f) II ..||26 



fm . ( llMinv^Y- (-1) M'' \,a+u 



We also have that 



Ml/: ,1 . oxp (-^) + ^) < +00 

converges absolutely and is holomorphic in the strip TZ (z) > —k 1161 Equation 5.2.1]. 



Appendix J 
Proof of Theorem IVI.1I 

Note that 

r+oo 

M [mmse; 1 + z] = / t^mmse {t) dt 
Jo 

g2 r+°° ±E? 



<.+00 -roc , ,s 

/ H + 1) *'^^) + 1)^0 

j2 +°° / ,\ 

^ / + 1) *'^^) + 1) 

/ /2y(^+^) r(i + z) ,._,a^., r(2 + 2z) ^ . (M;2 + ^;i-(I^ 

2 Udj v^(l + z)+^'* r(2 + z) 1 + 2/ 



where the second equality is due to the characterization of the canonical MMSE associated with BPSK in IH, the 
third equality is due to uniform convergence and the fourth equahty follows from algebraic manipulations. 

Appendix K 
Proof of Theorem IVIII.1I 

Consider the function: 

V 

snr p {snr) = {pi (snr) , . . . , pk {snr)) := aig max / (snr;pi, . . . 

Vie{i,...',fc},Pi>o 

It is possible to establish, from the KKT conditions associated with this optimization problem, that 

3snrQ > : 3e > : Vi e {1, . . . , k},ysnr > snro, (eKpi (snr) < - A rnmset {snrpi {snr)) snr — A {snr) 
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Therefore, due to the expansion embodied in Corollary III. 2 it follows, for i = 1, . . . , fc, that 

1 



mmsei {snrpi (snr)) 



snr'^pf (snr) 



O 



snr^ 



snr — )■ +00 



where 



which leads to 



Ti := exp 



\JM_ 

2(7? 



^ ^ M [mmsei] 2] 
2a| 



A (snr) snr 



PI {snr) 



O 



1 

snr 



snr — >■ +00 



A (snr) snr 



= O (1) , snr — )■ +c 



and 



p, (snr) 



A (snr) snr /i + i O (^) ' 
1 + 



A (snr) snr 



A (snr) snr 



1 

snr 



snr — +CX3 



+00 



O 



1 

snr 



snr — >■ +00 
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